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Asymptotic stability region of slotted- Aloha 
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Abstract — We analyze the stability of standard, 
buffered, slotted-Aloha systems. Specifically, we consider 
a set of N users, each equipped with an infinite buffer. 
Packets arrive into user i's buffer according to some 
stationary ergodic Markovian process of intensity A^. At 
the beginning of each slot, if user i has packets in its buffer, 
it attempts to transmit a packet with fixed probabiUty 
over a shared resource / channel. The transmission 
is successful only when no other user attempts to use 
the channel. The stabiUty of such systems has been open 
since their very first analysis in 1979 by Tsybakov and 
Mikhailov. In this paper, we propose an approximate 
stability condition, that is provably exact when the number 
of users N grows large. We provide theoretical evidence 
and numerical experiments to explain why the proposed 
approximate stability condition is extremely accurate even 
for systems with a restricted number of users (even two 
or three). We finally extend the results to the case of more 
efficient CSMA systems. 

Index Terms — Random multiple access. Aloha, stability, 
mean field asymptotics. 

I. Introduction 

Random multiple access protocols have played a cru- 
cial role in the development of both wired and wireless 
Local Area Networks (LANs), and yet the performance 
of even the simplest of these protocols, such as slotted- 
Aloha [1], [22], is still not clearly understood. These 
protocols have generated a lot of research interest in 
the last thirty years, especially recently in attempts 
to use multi-hop wireless networks (Mesh and AdHoc 
networks) to provide low-cost high-speed access to the 
Internet. Random multiple access protocols allow users 
to share a resource (e.g. a radio channel in wireless 
LANs) in a distributed manner without exchanging any 
signaling messages. A crucial question is to determine 
whether these protocols are efficient and fair, or whether 
they require significant improvements. 

In this paper, we consider non-adaptive protocols, 
where the transmission probability of a given trans- 
mitter is basically fixed. More specifically we analyze 
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the behavior the slotted-Aloha protocol in a buffered 
system with a fixed number of users receiving packets 
from independent Markovian processes of pre-defined 
intensities. We aim at characterizing the stability region 
of the system. This question has been open since the first 
stability analysis of Aloha systems in 1979 by Tsybakov 
and Mikhailov [27], and we will shortly explain why it 
is so challenging to solve. We propose an approximate 
stability region and prove that it is exact when the 
number of users grows large. To accomplish this, we 
characterize the mean field regime of the system when 
the number of users is large, explore the stability of this 
limiting regime, and finally explain how the stability 
of the mean field regime relates to the ergodicity of 
systems with a finite number of users. We also show, 
using both theoretical arguments and numerical results, 
that our approximate is extremely accurate even for 
small systems, e.g. with three users (the approximate 
is actually exact for two users). Our approach can be 
generalized to other types of non-adaptive random multi- 
access protocols (e.g., CSMA, Carrier Sense Multiple 
Access). We present this extension at the end of the 
paper 

A. Model 

Consider a communication system where N users 
share a common resource in a distributed manner using 
the slotted-Aloha protocol. Specifically, time is slotted, 
and at the beginning of each slot, should a given user i 
have a packet to transmit, it attempts to use the resource 
with probability pi. Let p = {pi, . . . ,p]\j) represent 
the vector of fixed transmission probabilities. When 
two users decide to transmit a packet simultaneously, 
a collision occurs and the packets of both users have to 
be retransmitted. 

Each user is equipped with an infinite buffer, where 
it stores the packets in a FIFO manner before there 
are successfully transmitted. Packets arrive into user 
i's buffer according to a stationary ergodic process of 
intensity Aj. The arrival processes are independent across 
users, and are Markov modulated. More precisely, the 
packet arrivals for user i can be represented by an ergodic 
Markov chain Ai = {Ai{t),t = 0, 1, . . .) with stationary 
probability tTj (a) of being in state a, and with transition 
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kernel Ki. The Markov chains Ai are independent across 
users and take values in a finite space A. If at time slot 
t Ai{t) = a, a new packet arrives into the buffer of 
user i with probability Aj^a = Aj x gij where the gi^a^ 
are positive real numbers such that Xl^g^ '^i{a)gi,a = 1- 
The average arrival rate of packets per slot at user i is 
then Aj. We use these chains to represent various classes 
of packet inter-arrival times. The simplest example is 
that of Bernoulli arrivals, i.e., when the inter-arrivals 
are geometrically distributed with mean l/Aj: this can 
be represented by the Markov chain Ai with one state. 
We could also represent inter-arrivals that are sums (or 
random weighted sums) of geometric random variables. 
In the following we denote by a j = A j / J2j t^e 
proportion of traffic generated by user i. 

Denote by Bi (t) the number of packets in the buffer of 
user i at the beginning of slot t. The state of the system is 
given by Z{t) = {Ai{t), Bi{t),i G {1,...,N}) at time 
slot t. Z = {Z{t), t = 0, 1, . . .) is a discrete-time Markov 
chain. The stability region is defined as the set of 
vectors A = (Ai, . . . , Aat) such that the system is stable, 
i.e. Z is ergodic, for packet arrival rates A. It is important 
to remark that, a priori, depends on the transmission 
probabilities p, but also on the types of arrival processes 
defined by the transition kernels K = {Ki, . . . , K^) 
and the parameters g = {gi^a, i = 1, ■ ■ ■ , N,a £ A). But 
to keep the notation simple, we use A^ to denote the 
stability region. 

B. Related work 

The problem of characterizing the stability region A^ 
has received a lot of attention in the literature in the 
three last decades. First of all note that when the system 
is homogeneous in the sense that K/\piY[j^i{^ ~ Pi)] 
does not depend on i, then one can show as in [5] that 
the stability condition is: Aj < Pin^yiCl ~ Pj) ^ 
regardless of the nature of the arrival process (in this very 
specific case, all buffers saturate simultaneously at the 
stability limit). For nonhomogeneous systems an exact 
characterization has been provided in [20], [23], [27] 
under general traffic assumptions but only for iV = 2 
users. For two users, the stability region A^ is defined 
by: A G A^ if and only if: 

either Ai < -P2), A2 < P2(l - Ai/(1 -^2)), 

or A2 < P2(l -Pi),M < - A2/(l -Pi))- 

The first (resp. second) condition is obtained assuming 
that at the stability limit, buffer 2 (resp. buffer 1) is 
saturated. When the number of users is greater than 
two, the stability region depends not only on the mean 
arrival rates Aj, but also on the other detailed statistical 



properties of the arrival processes. For example, when 

= 3, this is due to the fact that the stability condition 
for a particular buffer depends on the probability that 
the two other buffers are empty separately or simultane- 
ously. These probabilities actually depend on the detailed 
characteristics of the arrival processes, see e.g. [26]. For 

= 3 and Bernoulli arrivals, the stability region can be 
characterized [26]. When the arrivals are not BernoulH, 
the system stability region is unknown. 

When the number of users N exceeds 3, it becomes 
impossible to derive explicit stability conditions. For 
Bernoulli arrivals, as was shown in [26], the stability 
region A^ can be recursively described as a function of 
the various stability regions of systems with A^ — 1 users, 
A^~^, and of the probabilities that in these systems, 
some buffers are simultaneously empty. These proba- 
bilities are unknown in general, and so is the stability 
region. The results of [26] have been recently generalized 
to more general systems of interacting queues [8]. The 
only previous explicit stability condition for arbitrary A^ 
is given in [2]; unfortunately, to obtain this condition, 
the author has to assume that the arrival processes of 
the different users are correlated, which is unrealistic in 
practice. Some other authors have proposed bounds on 
the stability region, see e.g. [18], [21]. The basic idea 
behind most of the proposed bounds is to build systems 
that stochastically dominate (or that are stochastically 
dominated by) the initial system. For example, a system 
where one of the buffers is assumed to be always 
non-empty stochastically dominates the initial system, 
and hence has a smaller stability region. In [17] the 
reader will find an interesting discussion on the existing 
techniques to derive bounds of the stability region. 

It is worth remarking that often in the literature, 
researchers have been interested in deriving what we 
refer to as the capacity region of Aloha systems. It is 
defined as the set of vector A such that there exists 
a vector p of transmission probabilities such that the 
resulting system is stable. In this paper, we fix the 
transmission probabilities and investigate the stability 
region, i.e. the set of A such that the system is stable. In 
particular, if we succeed in characterizing the stability 
region for any vector p, then we may easily deduce the 
capacity region. 

C. Contributions 

The main contribution of this work is to propose a 
simple explicit approximate expression of the stability 
region A^. This approximate stability region A^ enjoys 
the following properties: 

• When the number A^ of users grows large, the gap 
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between and the actual stability region A^ 
vanishes. 

• Even for small systems, A^ proves to be very 
accurate. For N = 2, one actually has A^ = A^; 
for = 3 and any other number of users, the 
approximate region is very accurate. In fact, for 
any values of N, there exists an infinite number 
of points where the boundaries of A^ and of A^ 
coincide, which explains the accuracy. 

• A^ is insensitive, i.e., it depends on the arrival 
processes through their intensities Aj's only. 

To prove that A^ becomes exact when N grows large, 
we use a mean field analysis of the system, and we 
show that the stability of the finite system of queues 
and that of the mean field limiting regime are related (in 
fact equivalent when N grows large). To our knowledge, 
this is the first time mean field asymptotics are used to 
provide stability conditions of the finite systems. 

The paper is organized as follows. In Section II, 
the approximate stability region is proposed and the 
main result, i.e. the fact that A^ tends to A^ when 
N is large, is stated in Theorem 1. In Section III, we 
present theoretical arguments and numerical experiments 
to illustrate the accuracy of A^. Sections IV and V 
are devoted to the proof of Theorem 1: In Section IV, 
we present a mean field analysis of the system, and in 
Section V, we investigate the stability of the system in the 
limiting mean field regime, and explain why the stability 
condition obtained provides an ergodicity condition of 
the finite system of queues. We generalize our results 
to non-adaptive CSMA protocols in Section VI, and 
conclude in Section VII. 



II. Approximate stability region 

A. Approximate stability region 

We now provide an approximate expression of the 
stability region for a system with an arbitrary number 
of users. We prove that this approximation is exact 
when the number of users grows large. The approximate 
expression is valid for any arrival processes, which 
indicates that the stability region becomes insensitive 
when N grows. 

Roughly speaking, the approximate stability region is 
obtained assuming that the evolutions of the queues of 
the various users are independent. Let dj[0, 1]^ be the 
set of /3 G such that Vi, pi < 1, and pj = 1. The 
approximate stability region is the region lying below 



one of N boundaries djA'^ defined by: 
djA^ = |a : 3p e dj[0, ifyi, 

Ai = PiK JJ(1 - PkPk) >■ 

More precisely, A^ is the set of positive vectors A such 
that there exist j and a G djA^ with Aj < ai for all 
i. Note that A^ = A^, so the proposed approximation is 
exact when N = 2. 

Remark 1 (How to compute A^ ): Assume that the 
traffic distribution a = {ai,i = 1, . . . ,N), is fixed and 
let us find the maximum total arrival rate s* such that 
A = s*a belongs to the closure of A^. It can be easily 
shown that at this maximum, the user i* such that pi* = 1 
is i* = argmaxjai(l —pi)/pi- Indeed, since for all i, 
UiS* = piPi Ylj^ii'^ - PjPj)' *en ai{l - piPi)/ (piPi) = 
ai*{l -pi*)/pi*, and 

/ 1 ^ ai{l-pi) ai*{l-pi*) 

pi<l <S=^> < . 

Pi Pi* 

We deduce the maximum arrival rate: 

s* = EiLT\ ( \ 

~L~, \(^iPi* -Pi*)) ' 

B. Main result 

Our main result states that the actual stability region 
A^ is very close to the proposed approximation A^ 
when N is large. To formalize this, we introduce a se- 
quence of systems indexed by N, i.e., the arrival rates are 
A^ = (A^, . . . , A]^), the transmission probabilities are 
p^ = {p^ , . . . ,p^), and the Markov chains modulating 
the arrival processes are , . . . , A^. 

In order for a system with users to give reasonable 
bandwidth to each user the duration of a time slot must 
be of order seconds, i.e., we suppose r seconds will 
represent t = [Nt\ time slots. We assume that users 
can be categorized among a finite set V of F = |V| 
classes. Further we assume the proportion of users i in 
class V tends to (3^ when — > oo. The class of a user 
characterizes its transmission probability and the packet 
arrival process in its buffer. The transmission probability 
of user i of class v is pf = Pv/N. We assume that 
for all A^, YliPf — 1- This assumption is made so 
as to keep the approximation expression of the stability 
region simple. In Section V, we explain how to extend 
the assumption, and give ways to remove it. Note that, as 
Kleinrock already noticed [13], the assumption is needed 
to guarantee a certain efficiency of the system. 
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In order that the system not be overloaded, we assume 
that the mean packet arrival rate of user i of class v is 
= Xv/N. The class of a user also defines the Markov 
chain modulating its arrival process. If user i is of class 
V, this Markov chain is assumed to be in stationary 
regime with probability TTy{a) of being in state a, in 
which case the probability that a packet arrives in its 
buffer is Af^^ = A„ x gv,a/N, where g^^a are positive real 
numbers such that J2aeA (")5t),a = 1- We assume that 
the Markov chains A^ , . . . , A^ are independent. Denote 
by the transition kernel of Af. The Markov chains 
A^ may be fast or slow. In particular the arrival rate 
may change on the order of time slots if packets are 
generated by a HTTP connection since the transmission 
rate is changed dynamically by HTTP. On the other hand 
the state describing a VoIP connection would evolve on 
the scale of seconds as the speaker alternates between 
silent and speech periods. To represent these two scenar- 
ios, we introduce V continuous-time Markov processes 
A^ = {A^{t),t G f G V, taking values in A 

with jump rate kernel (expressed in transitions per 
second), and we assume that the corresponding Markov 
chains modulating the arrivals of the various users are 
as follows. 

Sequence of type 1 - Fast modulated arrivals. In this 
case, for all t = 0, 1, . . ., the law of Af {t) is equal to 
that of A^ (t) = Ay ( \Nt\ ) (recall that r seconds roughly 
represent Nt slots). In other words, the modulating 
Markov chain changes state on the scale of time slots; 
i.e. N times faster than the speed at which the user 
evolves (e.g. the speed at which the user attempts to 
transmit a packet). In this case Kf [a^ a') = P{Ay{l) = 
a'\Ay{<d) = a). 

Sequence of type 2 - Slowly modulated arrivals. In this 
case, for all i = 0, 1, . . ., the law of Af {t) is equal to 
that of Ay{t/N) = Ay{[NT\/N); i.e. the speed of the 
modulating Markov chains is proportional to the speed 
of at which the user evolves. In this case K^{a,a') = 
P{Ay{l/N) = a'\Ay{0) = a) « Ky{a,a')/N 

We denote by the stability region of the system 
indexed by N. As explained earlier, the stability region 
depends on the transmission probabilities and on the type 
of arrival processes. The following theorem compares 
the stability region A^ with our proposed approximation 
A^ as N gets large. The theorem is valid for both types 
of sequences of systems, 1 and 2. Since A^ does not 
depend on the kernels , the theorem indicates that 
when is large, the stability region depends on the 
arrival processes through the mean arrival rates only. 
Define 1^ := {1/N, . . . ,1/N). 



Theorem 1: For all e > small enough, there exists 
such that for all N > N^: 

(a) if A^ + e • 1^ G A^, then A^ € A^; 

(b) if A^ - e • 1^ A^, then A^ A^. 

Theorem [T] is proven in Sections IV and V. The main 
steps of the proof are as follows. 

(1) The evolution of the system when N grows large 
is characterized: it is shown that with an appropriate 
scaling in time, the evolution of the distributions of 
the various queues is the solution of a deterministic 
dynamical system. This result is obtained using mean 
field asymptotic techniques, as presented in Section 
IV.A. These techniques typically provide an approximate 
description of the evolution of the system over finite 
time horizons. Here we wish to study the ergodicity 
of slotted-Aloha systems, which basically relates to the 
system dynamics over an infinite horizon of time. Hence, 
classical mean field asymptotic results will be necessary 
but not sufficient to prove Theorem 1 . The main technical 
contribution of this paper is to explain how mean field 
asymptotics can be used to infer the ergodicity of the 
finite systems, and this is what is done in steps (2) and 
(3). 

(2) We provide sufficient and necessary conditions for 
the global stability of the dynamical system describing 
the evolution of the system in the mean field regime. 

(3) Finally, it is shown that the ergodicity of the initial 
system of N queues is equivalent to the stability of the 
mean field dynamical system when N grows large. 

Remark 2 (Capacity of Aloha systems): A 
consequence of the above result is that when 
grows large, and whatever the arrival processes 
considered, the set traffic intensities A such that there 
exist transmission probabilities p stabilizing the system 
is the set M.^ with boundary dM.^ \ 

5>(^ = |a:3pi,...,p„g(0,1): 

Vi,Ai -pj) \. 

This result has been conjectured by Tsybakov and 
Mikhailov in [27]. It has been proved in [2], but under the 
assumption that the arrival processes of the various users 
are correlated. The authors of [17] have introduced the 
so-called sensitivity monotonicity conjecture under which 
they could also prove the result. Theorem 1 says that 
when the number of users is large enough, the sensitivity 
monotonicity conjecture is not needed. 

Remark 3 (Shannon capacity of Aloha sy steins): It is 
worth noting that coincides with the Shannon ca- 
pacity region of the multi-user collision channel derived 
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in [11], [19]. Theorem 1 shows that the capacity region 
and the Shannon capacity region are equivalent when the 
number of users grows large. In [24] the reader will find 
a more detailed discussion on the comparison of these 
two regions in communication systems. 

III. Accuracy of 

How far is the approximate region A^ from the actual 
stability region? Theorem [T] says that the gap tends to 
when the number of users grows large. But even 
for small A^, A^ is quite an accurate approximation as 
illustrated in the numerical examples provided later. Why 
is the approximate region so accurate? 

A. k-Homogeneous systems 

This accuracy can be explained by remarking that the 
boundaries of the regions A^ and A^ coincide in many 
scenarios. Remember that A^ can be interpreted as the 
stability region one would get if the evolutions of the 
different buffers were independent. As a consequence, 
it provides the exact stability condition for scenarios 
where, in the stability limit, the buffers become inde- 
pendent. 

Definition 1 (k-homogeneous directions): A direction 
(a vector with unit Li-norm) a G is /c-homogeneous 
for the system considered if there exists a permutation a 
of {!,..., A^} such that, for all i = 1, . . . , /c, ao-(i) (1 — 
Pa{i))/Pa{i) docs not depend on i. 

In the following, without loss of generality, when a 
direction is /c -homogeneous, the corresponding permu- 
tation is given by a{i) = i for all i. The following 
proposition, proved in appendix, formalizes the fact that 
the boundaries of A^ and A^ coincide on a set of curves 
corresponding to particular directions, fc-homogeneous 
directions. In case A^ = 3, Figure [T] gives a schematic 
illustration of these curves. 

Proposition 1: Assume that A = s x a, where a is a 
fc-homogeneous direction for the system considered. 
Define s* = sup{s > : sa € A^} and similarly s*. 

Then if lfc+i<Arafc+i(l -pk+i)/Pk+i < ai(l -Pi)/pi 
and ai = for I > k + 1, then: 

nti(i-K) 



-ai + Ofc+i 



B. Numerical examples 

We now illustrate the accuracy of A^ using numerical 
experiments. 

Example 1: First, we consider the case of A^ = 3 




Fig. 1. Curves where dK'^ and coincide. A — (pi(l - 

P2),P2(l-pi),0); B = (pi(l--p3),0,p3(l-pi)); C = (0,P2(1^ 

P3),P3(1-P2)); D = (P1(1-P2(1-P3),P2(1-P1(1-P3),P3(1^ 
Pl)(l -P2)). 



sources, each transmitting with probability 1/3. We vary 
the relative values of the arrival rates at the various 
queues: Ai = A, A2 = A x (^+^/^) and A3 = \/x. We 
vary x from 1 to 50. It can be shown that the approximate 
stability condition is 
3 

i=l 



Ax{x + 1) 



(2x + l)(52; + l)' 

In Figure |2] (left), we compare this limit to the actual 
stability limit found by simulation with Bernoulli arrivals 
(Simulation 1) and hyper-geometric arrivals (Simulation 
2). In the latter case, the inter-arrivals for each user 
i are i.i.d., and an inter-arrival is a geometric random 
variable with parameter aAj with probability 1/2, and 
(1— a)Aj with probability 1/2. This increases the variance 
of inter-arrivals (when a is small the variance scales as 
1/a). In the numerical experiment, we chose a = 1/5. 
Remark that the stability region is roughly insensitive 
to the distribution of inter-arrivals. This insensitivity has 
been also observed in the other examples presented in 
this section. The simulation results have been obtained 
running the system for about 10^ packet arrivals. Note 
finally that the arrival rates are chosen so that the system 
is not fc-homogeneous. 

Example 2: We make a similar numerical experiment 
when pi,P2,P3 are equal to 0.6, 0.3, 0.1 respectively. 
The arrival rates at the three queues are as in Example 
1. We vary x from 0.1 and 10. For x < xq = 47/7, 
at the boundary of A^, queue 3 is saturated (ps = 1); 
whereas for x > xq, queue 2 is saturated (p2 = 1). The 
approximate stability condition is: 

3 ( 7.2x{x+l) 

j;A,<r = 

i=l 



(7x+3)(2x+3)' if a; < 47/7, 

i^-i{x+ir if T> 47/7 
(13a;+7)(73;+13) ' lia;>4/-//-. 



Figure |2] (center) illustrates the accuracy of A"^. 
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Approximation 
Simulation 1 
Simulation 2 




10 20 30 40 
Ratio of arrival rates at queues 1 and 3 




Ratio of arrival rates at queues 1 and 3 



0.48 
0.44 
0.4 

0.36 
0.32 




2 5 10 15 20 25 30 35 40 45 50 

Number of users N 



Fig. 2. Maximum total rate compatible with stability - Left: Example 1, = 3, (pi,P2,P3) = (0.6, 0.3, 0.1) - Center: Example 2, A'^ = 3, 
(pi,P2,P3) ~ (0.6,0.3,0.1) - Right: Example 3, A'^ varies, linearly decreasing traffic distribution /3i. 



Example 3: Finally, we illustrate the accuracy of 
when the number of users N grows. Each user is 
assumed to transmit with probability and the traffic 
distribution is such that ai > for all i > 2. Hence, 
again the system is not ^-homogeneous. One can easily 
show that in this direction, the approximate stability 
condition is: 

N 1 ^ / a- \ 

In Figure |2] (right), we compare the boundary of 
with that of A^ when the distribution is linearly 
decreasing with i. Again as expected, s* provides an 
excellent approximation of the saturation level in the 
actual system. 

The two next sections are devoted to the proof of 
Theorem 1. In section IV, we provide a classical mean 
field analysis of the system, and in Section V, we show 
how the stability in the limiting mean field regime 
translates into the ergodicity of the initial finite systems. 

IV. Mean field asymptotics 

In this section, we first present a generic mean field 
analysis of a system of interacting particles and then 
apply the results obtained to slotted-Aloha systems. Let 
us first give some notations. 

Notations. Let be a complete separable metric space, 
V{y) denotes the space of probability measures on 3^. 
C{X) denotes the distribution of the J^-valued random 
variable X. Let D(M+, y) be the set of right-continuous 
functions with left-handed limits, endowed with the 
Skorohod topology associated with the metric d^, see 
[4] p 168. With this metric, Z)(M+,3^) is complete and 
separable. For two probability measures a, /3, we denote 
by ||a — their distance in total variation. 



A. A generic particle system and its mean field limit 

Consider a system of N particles evolving in a state 
space V X at discrete time slots t G N. V is a finite set, 
and X is at most countable. At time t, the state of particle 
i is Xf{t) = {v^, Yf{t)) eVxX. The first component 
of X^{t) is fixed, and is used to represent the class 
of a particle as explained below. YJ^ (t) represents the 
state of particle i at time t. The state of the system at time 
t can be described by the empirical measure i^^(t) = 

Each particle i is attached to an individual environment 
whose state Af {t) at time slot t belongs to a finite 
space A. Af = {Af{t),t = 0, 1, . . .) is a Markov chain 
with kernel Ki independent of A^. Particles of the same 
class share the same kernel: implies Ki = Ki>. 

The Markov chains Af are independent across particles, 
and are assumed to be in stationary regime at time 0. 
Let vr^ be the stationary distribution of the individual 
environment of a class-v particle. 

Evolution of the particles. We represent the possible 
transitions for a particle by a finite set S of mappings 
from to A s-transition for a particle in state x = 
{v,y) leads this particle to the state s{x) = {v,s{y)). 
In each time slot the state of a particle has a transition 
with probability independently of everything else. 
If a transition occurs for a particle whose individual envi- 
ronment is in state a ^ A, this transition is a s-transition 
with probability {x,v,a), where x, a, and v denote 
the state of the particle, the empirical measure before 
the transition and the state of its individual environment 
respectively. Hence, in this state, a s-transition occurs 
with probability: 

^F^{x,u,a). (1) 

with Yls&s z/, a) = 1 for all (x, i/, a). 

Note that we do not completely specify the transi- 
tion kernel of the Markov chain {{Xf {t), Af {t),i = 
1, . . . , N),t = 0, 1, . . .). All what we require is that each 
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particle has a transition with probability indepen- 
dently of the other particles. However given that transi- 
tions occur for two (or more) particles, these transitions 
can be arbitrarily correlated (but with marginals given 
by ([ill). Note also that the chains Af evolve quickly 
compared to X^^ . 

We make the following assumptions on the transition 
probabilities . 

Al. Uniform convergence of to F,: 

sup \Ff^ {x, a, a)—Fs{x, a, a)\ ^^^^ p. 

{x,a,a)eXxP(X)xA 

A2. The functions Fg are uniformly Lipschitz: for all 

sup ^ \Fs{x,a,a) - Fs{x,(3,a)\ < \\a - (3\\. 

In what follows, we characterize the evolution of the 
system when the number of particles grows. According 
to ([T|), as iV — *■ c», the evolution of {t) slows down 
(where t is measured in slots). Hence to derive a limiting 
behavior we define: {t) = Xf {\_Nt\) where r is 
measured in seconds. When ^ oo, the environment 
processes evolve rapidly, and the particles see an average 
of the environments. We define the average transition 
rates for a particle in state x = {v,y) hy 

,a,a)TTi,{a). (2) 

aeA 

1) Transient regimes: 

Theorem 2: Suppose that the initial values qf (0), 
i = 1,...,N, are i.i.d. and such that their empirical 
measure converges in distribution to a deterministic 
limit Qo G V{X). Then under Assumptions Al and A2, 
there exists a probability measure Q on L)(M"'", X) such 
that for all finite set X of / particles: 

lim (.), i£l) = Q®^, weakly. 

N—*oo 

In the above theorem q^ {■) denotes the trajectory of 
particle i, which is a random variable taking values in 
D{M.'^,X). The result is then stronger than having the 
weak convergence of the distribution of qfir) in V{X) 
for any r. For instance, it allows us to get information 
about the time spent by a particle in a given state during 
time interval [0, 1]. 

The theorem states that the trajectories of the parti- 
cles becomes independent when the number of particles 
grows large. The independence allows us to derive an 
explicit expression for the system state evolution. 
Define Q"-{t) = Q(r)({2;„}) where X = {xn,n G N}. 
Q"'{t) is the limiting (when N oo) probability 



that a particle is in state Xn at time r, Q"'{t) = 
limAT^^oo Pr[qf{T) = x„]. 

Theorem 3: For all time r > 0, for all n G N, 

^ = E E Q'"(T)F.(x^,Q(r)) 

sg<S m:s{x,„)=x„ 

-5^Q"(t)F,(x„,Q(t)). (3) 

The differential equations ^ have a natural simple 
interpretation: 

^ ^ Q™(T)F,(x^,Q(r)) 

is the total mean incoming flow of particles to state Xn, 
whereas 

J]Q"(r)F,(x„,g(T)) 

is the mean outgoing flow from x„. 

2) Stationary regime: Theorems 2 and 3 characterize 
the limiting system evolution on all compacts in time. 
Hence, they do not say anything about the long-term 
behavior of the system. Here we will assume that the 
finite particle systems are ergodic and describe the mean 
field regime of the systems in equilibrium. To do so, we 
need two additional assumptions: 

A3. For all N large enough, the Markov chain 

{{Xj^{t),Af{t),i = l,...,iV),t = 0,1,...) is positive 

recurrent. The set of the stationary distributions vr^ of 

the systems with particles is tight. 

A4. The dynamical system Q is globally stable: there 

exists a measure Qst = (Qst) ^ V^X) satisfying for all 

n: 

E E Q':iFs{Xm,Qst) = Q':t^FsiXn,Qst), 
sGS m:s{xm)=x„ seS 

(4) 

and such that for all Q G 'P{D{R+,X)) satisfying ©, 
for all 71, lim^^_|_oo (5"(t) = Q^^. Then the asymptotic 
independence of the particles also holds in the stationary 
regime, and Qst is the limiting distribution of a particle: 

Theorem 4: For all finite subsets / C N, 

lim {{qf{.)hei) = QT weakly. 

iV — ^oo 

Theorems 2, 3 and 4 can be obtained applying clas- 
sical mean field proof techniques, such as those used in 
[9], [10], [25]. The interested reader is referred to [6] for 
complete proofs of similar results in the case of a much 
more general system model^. 

'We do not provide the proofs here, but could include them upon 
editor's request. 
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B. Slotted-Aloha systems - Sequence of type 1 

Consider a type-1 sequence of slotted- Aloha systems 
as described in the paragraph preceding Theorem 1. In 
the system with N users, consider a class-w user i. When 
it has a packet in its buffer, it transmits with probability 
= Pv/N. The packet arrivals in its buffer are driven 
by a ^-valued Markov chain in stationary regime 
with distribution tt^ and whose transition kernel Ki de- 
pends on V only. When (t) = a, a new packet arrives 
in its buffer with probability Xa^v/N = A„ x gv,a/N 
(refer to Section II-AI for the notation). 

The system can be represented as a system of inter- 
acting particles as described in Section IV.A. Each user 
i corresponds to a particle whose state Xj^ (t) at time 
slot t represents its class v, and the length Bf{t) of 
its buffer: = (t)); i.e. Yf{t) = 5f (i). 

The individual environment of particle i at time slot t is 
A^{t). Denote by iy^{t) the empirical measure of the 
system at time slot t: i^^ (t) = YliLi 

Assume that at time slot t, the empirical measure is v. 
The possible transitions for a user / particle are a packet 
arrival in the buffer (we index this kind of transition by 
b), and a packet departure (indexed by d). Then S = 
{b, d}. If user (/particle) i is in state x = {v, k), and if 
its individual environment Af^{t) is o, the probabilities 
of transition for the next slot are given as follows. The 
state becomes {v,k + I) with probability: 

u, a)/N = A,, JiV + o{l/N), 

and (f , k — 1) with probability: 

F^{X,1^, a) ^ lk>0Pv -pr _Pv^^p«u"+N:^c, /^^ 



2_ 

N 



where is the proportion of users of class v and u^'^ is 
the proportion of users of class v with non-empty buffers. 
Denote by /3,u the proportion of class-u users at the limit 
when N grows large. When — > oo, the functions , 



converge to Fi,, F^ where: 

Ff,{x,u,a) = A„ 
Fd{x, V, a) = lk>oPv exp (- 



Pv'^t'Pv 



One can easily check that Assumptions Al and A2 are 
satisfied. Moreover, the limiting averaged transition rates 
are: 

Fh{x,u) = A^, 



Fd{x,u) = lfc>oPi,exp(- 



Pv'J^^'Pv 



At time 0, we apply a random and uniformly dis- 
tributed permutation to the users so that their initial states 



become i.i.d.. This operation does not change the stabil- 
ity of the system. Finally we scale time and consider 
qfir) = X;^ {[Nt\). We can apply Theorems 2 and 3, 
and conclude that when N grows large, the evolutions 
of the users become independent. Furthermore, at time 
r, if Q(v,k){T) denotes the limiting probability that a 
user of class v has k packets in its buffer (Q(t,,fc)(T) = 
limAT^oo Pr[ql^{T) = {v, k)]/ (3^), we have: 

OCJty k) / 

(t) = Xv {'^k>oQ{v,k~l){T) - QivM'^)) 

+p„exp(-7(r)) {Q{v,k+i)(.T) - lk>oQ{v,k)(.T)) . 

with 

7(t) 



E 



/3vPvl^t(.T) = ^PvPv{l - Q{v,0){t))- (6) 



For a given v, equations ^ are the Kolmogorov equa- 
tions corresponding to the evolution of the number of 
clients in a queue with Poisson arrivals, exponential 
service requirements, and time-varying capacity equal 
to exp (— 7(r)) at time r, in short to an M/Mr/l 
queue. One can also write the evolution of the workload 
Wv{t) = J2k f^Q{v,k){T) of a queue of class v: 

^(r) = A„ -p,e-^W(l - Q(,,o)(r)). (V) 

Finally, multiplying by /3y and summing over v, we can 
characterize the evolution of the total workload W{t) = 
EvPvW„{t) as: 

^W{t) = PvXv - lit) exp(-7(r)). (8) 

C. Slotted-Aloha systems - Sequence of type 2 

Consider now a sequence of slotted- Aloha systems of 
type 2. Here the Markov chains modulating the arrival 
processes evolve at the same rate as the users. The only 
difference with a sequence of type 1 is then that for 
any user i of class v, we have for all a ^ a' £ A, 
Kf{a,a')KKy{a,a')/N. 

Again, the system can be represented as a system 
of interacting particles, but without individual environ- 
ments: the state of the Markov chain modulating the 
arrival process is included in the particle state. Hence 
we define: Xf{t) = (v, (t), A^ (t)); i.e. Y^^ (t) = 
{B^ (t), Af (t)). We have now three types of transitions: 
arrivals, departures, and changes in the state of the 
modulating Markov chain. Assume that at time slot t, 
the empirical measure of the system in u, and consider a 
particle in state x = {v,k,a). The transition probabilities 
for the next slot are given as follows. The state becomes 
{v, k + l,a) with probability: 

F,^(x, i/)/iV = A,, JiV + o(l/iV); 
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it becomes {v,k — l,a) with probability 



N 



N{-\ 



N ' 



N 



+ o{l/N), 



where is the proportion of users of class v and is 
the proportion of users of class v with non-empty buffers; 
finally it becomes {v,k,a') with probability: 

FiJ,,)(x, u)/N = K,{a, a')/N + o{l/N). 

When N oo, the functions , , and F^^,^ 
converge respectively to F^, F^, and F^(^^,-^ where: 

Fb{x,ij) = A„,a, -Fc(a')(^'^) = K^{a,a'), 

Fd{x,u) = lk>oPv exp (- I3^> v^,p^, ) . 



Again one can easily check that Assumptions Al and A2 
are satisfied. Denoting qf (t) = {[Nt\), we show 
as previously that if Q(v,k,a){T) = limAr_^oo -Pr[gf (r) = 
{v, k, a)]//3^, then: 

dQ{v,a,k)iT) sr- ^ ' \r^ r \ 
q;^ = 2^ Kv{a ,a)Q^^^a',k){V 

-Q{v,a,k){T) ^ Ky{a,a) 
a'eA 

+K,a (lfc>0<3(D,a,fc-l)('r) - Q{v,a,k){T)) 
+p^,exp(-7(t)) {Q(y,a,k+1)(.T) - lk>oQ{v,a,k}{'^)) , 

where 7(r) is given by Q with Q[v,k){'T) = 
(''")• ^ given V, equations ^ are the 
Kolmogorov equations corresponding to the evolution of 
the number of clients in a queue with Poisson-modulated 
arrivals, exponential service requirements, and time- 
varying capacity equal to p„exp(— 7(r)) at time r. In 
the following, we denote by M^^/M,-/! such a queue: 
the superscript represents the kernel of the process 
modulating the arrival rates, the subscript r means that 
the capacity is time-varying. 

Now for a given class v, multiplying Q by k, and 
then summing over a ^ A and k > 0, one gets ^ 
where Wy{T) = J2kYla^Q(v,a,k){''')' this is due to the 
fact that we assumed that the Markov chains modulating 
the arrivals are initially in their stationary regimes, which 
implies that for any r, J2k ^a.,vQ{v,a,k){T) = Xv Note 
finally that dSjl is also valid (as a direct consequence of 
©). 

V. Asymptotic stability 

A. Stability of the limiting system 

We now investigate the stability of the dynamical 
system Q-® corresponding to a sequence of slotted- 
Aloha of type 2. Actually, analyzing the stability of ([9])- 
^ is more difficult than analyzing that of the dynamical 



system ©-Q corresponding to a sequence of slotted- 
Aloha of type 1. As it turns out they have exactly the 
same stability condition. We let the reader adapt the 
following analysis to the case of the system dS)-©. 

Assume that Yl^vl^^'^v < e"^- In the following we 
denote by 7(A) and 7(A) the unique solutions in (0, 1) 
and in (l,oo), respectively, of: 



76 



A 



^ ^ Pv Ai; . 



(10) 



Define the function ^ from [0, 00) to [0, e~^] by ^{x) = 
xe~^. Let ( := J2v PvPv The stabiUty of the dynamical 
system is given by: 

Theorem 5: (a) Assume that: 

C < 7(A) and \/v € V, A,„ < p„ exp(-7(A)), (11) 



then the dynamical system ©-Q is globally stable, and 

P > 7(A). 

(b) If for some v € V,Xv > Pi, exp(— 7(A)) or if C < 
(9) 7(A) then the dynamical system is unstable. 

(c) If C > 7(A), then the system is not globally stable. 

The above theorem states that the stability region of 
dill-® is T{l,V), where for b G [0,1], r{b,V) is the 
following subset of R^: 

{A G : 3p € [0, 1]^ : Vv, A„ = p^p^fte" '^"''"P"}. 

Actually, one can easily prove that r(6, V) is the sta- 
bility region of a generalized system obtained from 
dUl-© by adding a slot availability probability b to 
the service rate of class-t; users; i.e. this service rate 
becomes bpv exp(— 7(t)). We now provide an alternative 
representation of r{b,V). Define A{b,V) as the subset 
of M.^ whose upper Pareto-boundary is the union of the 
following surfaces dvA{b, V): 



Xu = PuPube' 



Vn, 



In the following, we use the following notation: for all 

G M^, (^,(/>) := J2v^v(Pv- We prove that when 
(/3,p) = ( < 1, then A{b, V) = T{b, V). Let component 
V of the function / be fv{g) = bg^ exp{—{(], g)), and 
let V = [0,pi] X . . . X [0,pv]. The derivative df of / 
is bexp{-{P,g)){I - g(f) where g^ = {gi,...,gv) 
and P'^ = (/?!, . . . , Pv)- {I — gP"^) is a rank one matrix 
with one nonzero eigenvalue, (/?, g) associated with the 
eigenvector g. Since Y^uPugu < T.v PvPv < 1, the 
inverse of df is the positive matrix b~~^ ex.p{{P, g)){I + 
(1 — {P, g))~^gP'^) by inspection. / is clearly one-to- 
one from V to the star-like domain /("P) = T{b, V). 
Since df is nonsingular it follows that the image of 
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points g in the interior of V are mapped to the interior 
of f{V) (since f{g + h) — f{g) includes a ball around 
g by first order approximation) and that points g on the 
boundary of V are mapped to the boundary of f{V) 
(again by first order approximation). It is also clear that 
the upper, respectively lower, boundary of V is mapped 
to the upper boundary (the union of the dyK{b, V)), 
respectively lower boundary of f{V). Moreover, since 
the inverse of df is a positive matrix, it follows that 
if a < A G T{h,V) then a G T{h,V). It follows 
that the boundaries of f{V) are Pareto boundaries so 
K{h,V)=T{h,V). 

Proof of Theorem^ The proof is based on the proba- 
bilistic interpretation of the dynamical system ©-dU as a 
collection of M^/M^/1 queues: a queue parameterized 
by V has Markovian arrivals of intensity A„ and following 
kernel K^, and it is served at rate exp (— 7(r)) at time 
r. 

Now for two probability measures a, o"' on N x A, 
we write a <st o' (and say that a' is stochastically 
greater than a) if for all A; € N and all a ^ A, 
YA=o'^a,i > YA=Q^'ar ^ Collection a = {a^.v £ 
V) of probability measures on N x ^, we also define 
7a = — ai),a,o)- For two sets of measures 

a, a': 

if Vf , <st a^, then 7^ < 7^', Va G A. (12) 

Let us now denote by Q"{-) the set of probability 
measures solution of dl])-© with for all v, Q^{0) = a^. 
We also define 7"(-) = Evev " Qf.,o)(-))> and 

for all V, W^{-) the workload of a queue of type v when 
the system starts in state a. Q^{t) is obtained when we 
start with an empty system, i.e., J2aeAQ^{v,a,k)(.^) = 
lfc=o for all V. We have: 

Lemma I: If for all v, <st ct'y, then 

Vr>0, Q"(r) <,tQ"'(r). 

Furthermore: Vr, h>0, Q'^{t) <st Q^{t + h). 

Proof. The proof of the first statement can be made using 
([T2I ) and standard coupling arguments [16]. It suffices 
to observe that the arrivals are exogenous so we can 
make the arrival process identical in both copies of the 
coupled chains. Also note that (fT2l ) implies that the 
service rates of the queues in the system starting from 
a remain always greater than those of the queues in the 
system starting from a' . To prove the second statement, 
observe that for all v, Q?^^' >st QS(0) = 0. Hence by 
monotonicity, Q^,{t + h) ^ Q'^^^^Xt) >st ° 

Proof of (a): Stability starting from an empty system. 
Assume that we start from an empty system. Then 



7'^(r) = and from Lemma [TJ Q^{t) is stochastically 
increasing in time, and ^^{t) is a non-decreasing 
function. This also implies that W^{t) increases, and 
then, by ([8]l: 

Vr,A > 7°(r) exp(-7°(r)). 

Remark also that 7*^ (r) converges to some G when r 
00. From the above equation, we deduce that G < 7(A) 
since by ([8]l, W^{t) decreases if 7°(r) > 7(A). Next 
At, < pi, exp(— 7(A)) < p^exp(— G) so the workload 
Wi, is stable as j^{t) G and the distribution of 
queue v is that of an M^^/M/l queue with service rate 
p„exp(-G). Hence, G = Yjv PvPvK / {Pv ^^^vi-G)) so 
i{G) = A and G = 7(A). 

Finally, p > 7(A) is directly deduced from A„ < 
Pt,exp(-7(A)). 

Proof of (a): Arbitrary initial condition. 

We first state a further property of a system starting 
empty. The result, proved in appendix, says that ^^{t) 
converges rapidly to 7(A) when t ^ 00. 

Proposition 2: Define for all r > 0, /(r) = 
~ Then we have: 



f{u)du < 00. 



(13) 



Assume that the initial state is a = {a^jV € V). By 
monotonicity, (r) < Q^^ (r) for all v and r. This 
implies for any r: 

7"(t)>7°(t). (14) 

Note also that 7"(r) < C < 7('^) (the latter inequality is 
by assumption). Combining this observation with (fT4l ). 
we deduce ^(7"(t)) > ^(7°(t)), or equivalently 

^(7"(r))>e(7(A))-/(r). (15) 

Also by monotonicity: W°'{t) > W^{t). Hence we 
have: 

VF°(oo) - VF"(0) < PF°(cx)) - PF°(0) 

r-oo Q^^a 



dT 



-{u)du 



UlW)-ar{u))]du 

3 

[ai''{u))-aiW)Ydu 

) 

[e(7-(n))-e(7(A))]+rfn, 



where for any real number x, = max(0, x) and x 
— min(0, x). From (fTSl) . we deduce: 



< 



f{u)-m^%u))-ai{m 



du, 
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and from ( [T3] ). conclude that: 

[e(7"(n))-^(7(A)rdn<oo. 

However the derivative of 7"(-) is bounded (see so 
we obtain (,{j°'{t)) CilW) when r ^ oo. Finally 
7"(t) 7(A) when r ^ 00. Now as before, if A^, < 
exp(— 7(A)), queue v is stable. Summing over v gives 

7(A) < C 

Proof of (b): Using monotonicity again, to prove the 
result, we just need to prove instability for a system 
starting empty. As previously, 7°(r) —>^G< 7(A) when 
T 00. Suppose some queues {v G S'^} are unstable 
while the rest {v € S} are stable. Consequently, 

TdvPv+yjvPvii-ii 



G 



■)) 



Pjj exp(-G) • 

C' + (A - A')e^ 

where C' = Y^veS- f^^Pv and A' = Y.vgs- f^^'^^- *ere 
is a t; such that At, > pv exp(— 7(A)), then G < 7(A) and 
the workload diverges. If C < 7(A) then 7''(r) < 
C < 7(A) so it follows from dSjl that the workload tends 
to infinity and G < 7(A). 

Proof of (c): We just show here that the dynamical 
system has two fixed points. We have already shown 
that, if for all v, < p„ exp(— 7(A)), and if the system 
start at 0, then it converges to a fixed point where 
7(t) = 7(A) and where a queue of subset v has the 
same distribution as a stationary M^"/A//l queue of 
capacity p„ exp(— 7(A)). 

Now the second fixed point is obtained as follows. 
Assume A^, < p^exp(— 7(A)) for all v. Suppose also 
that the initial condition for queues of subset v is 
the stationary distribution of an M^^"/M/l queue with 
capacity p^, exp(— 7(A)). Then the derivatives in ^ are 
all and we have identified a second fixed point. □ 

B. Stability of the finite system of queues 

To conclude the proof of Theorem [T] we need to relate 
the stability region of the dynamical system ©-Q to the 
stability region of the finite system of queues. 

1) Sufficient ergodicity condition: The arrival (resp. 
transmission) rate of a user i of class v G V is Xi,/N 
(resp. Pv/N). Let A^ = (Ai, . . . , Ay). Then, in this 
setting, A^ + e • 1^ G iff A^ + e • ly € A^(l, V), 
where ly is the F-dimensional vector (1, • • • ,1), and for 
b € [0, 1], A^(6, V) is the subset of whose Pareto- 
boundary is the union (over v) of the following surfaces: 

{A : 3ped^[0,l]^ -.W, 

-L P^' N u 



Xv' 



One can easily see that for N large enough, A^(6, y) 
is very close to A(6, V) (their Hausdorff distance is of 
order 1/A^). From this we deduce that there exists N^, 
such that for all > iV^ , A^ + e • ly G {!,¥). 
Define t^{b,V) as: 



{A€ 



3pe [0, 1]^ -.Wv, 



All 



bpvPv 



1 



Pv ]y 



Pu 



N' 



}• 



We can prove (as done after Theorem 5) that when 
<1, A^(6,y) = f^(6,y). 

We now consider systems built from our original 
systems but such that each slot is available for trans- 
mission with probability b, i.i.d. over slots. We show the 
following result by induction on V, and deduce Theorem 
1 (a) applying it for 6 = 1. 

"If there exists an e > small enough, such that for 
A^ sufficiently large, A^ + e • ly G k^{b,V), then the 
system with N queues is stable. Furthermore in such 
a case, the stationary distributions vr^ of such systems 
constitute a tight family of probability measures." 

Let us first prove the result when y = 1. In such 
case, all the queues are similar, and the system is 
then homogenous. We have A^(6, 1) = A^(6, 1) and 
the system is stable iff A^ < Pvb{l — p^/N)^^^ by 
[26]. Now assume that X^ < Pvb{l — Pv/N) 



N-l 



€. 



Consider a particular queue: at any time, its distribution 
is stochastically bounded by the distribution we would 
obtain assuming that all the other queues are saturated. 
In the latter system, the stationary distribution of the 
queue considered is that of a Markovian queue of load 
Xv/{Pvb{l - Pi,/N)^~'^) < 1 - ae for some a > 0. 
Tightness follows. 

Now let us assume that the result is true when |V| < 
V, and let us prove it when |V| = F + 1. Assume that 
for A^ large enough, A^+i + e • ly+i e A^{b,V + 1). 
Denote by A^"*"^'^ the ^/-dimensional vector built from 
A^+^ where the f-th component has been removed. 
Since A^(6, V + 1) = f ^(6, V + 1), there exists v such 
that: for A^ large enough, 

A^+i.- + e-lveA^ (b{l - ^)/3."^, . (16) 

Consider the stochastically dominant system where all 
queues of class different than v see saturated queues of 
class V. For the latter sub-system, in view of ([T6l ). we 
can apply the induction result. We conclude that for A^ 
large enough, the dominant system without queues of 
class V is stable, and that the family of the corresponding 
stationary distributions vr^'" is tight. 
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From Theorem 5 applied to the dominant systems with- 
out queues of class v, we know that the correspond- 
ing limiting system is globally stable. We can then 
apply Theorem 4 to these systems to characterize the 
average proportion of slots left idle by the queues of 
class different than v: when N —>■ oo, this propor- 
tion tends to exp {—a) where a is the lower solu- 
tion of (Te~°".6e~^*'P*' = Yluy^v f^u^u- Now consider a 
queue of class v in the dominant system. Denote by 
{S^,t > 0) its service process. We can make this 
process stationary ergodic just assuming that initially the 
system without queues of class v is in stationary regime. 
The service rate of a queue of class v converges to 
bp^ exp(— (t) exp{—(3ypy) when N oo. Hence when 
N is large enough, we have: 

E[S^] > bpv exp(-o-) exp{-Pypy) - e/4. 

Now since A^+^ + e • ly+i G A^{b, V + 1), we have for 
N large enough: 

A^, < bpv exp(-o-) exp(-/?„p„) - e/2 < E[S^] - e/4. 

We deduce that in the dominant system, the queue 
of class V axe stable for large enough, and that 
their stationary distributions are tight. We conclude the 
proof noting that the original systems are stochastically 
dominated by systems that are stable for N large enough, 
and such that their stationary distributions are tight. 

2 ) Necessary ergodicity condition: We now prove that 
there exists an integer N^^ such that for all N > N^, the 
system is unstable if — e.l^ ^ or, equivalently, 
if 

A^-e.V^A^(l,y), (17) 

where A^{l,V) is defined in the previous paragraph. 
The system is monotone with respect to the arrival pro- 
cess: if we remove some incoming packets, the buffers 
cannot increase. Hence it is sufficient to prove that a 
modified system obtained from an independent thinning 
of the arrival process of all users is unstable. 

We first perform this suitable thinning. By assump- 
tion, there exists G (0, 1) such that t^A^ € 
A^(l, V). Then, there exists a class v such that t^A^ S 
dyA^ {1,V). Up to extracting a subsequence, we may 
assume that this class v does not depend on A^, for 
N large enough. Note also that the convergence of 
A^(l, V) to A(l, V) implies that converges to some 
t* G (0,1) such that t*X^ G dvA{l,V). We assume 
for simplicity that there exists a unique class v like 
that (the proof generalizes easily by performing a non- 
homogeneous thinning). Then, from Assumption ( [TT] ). 
we can choose 77 > small enough such that t := 



t* + 1] e (t*,l) satisfies for some e' > and all N 
large enough, 

a^''' + 6'v_lGA^((l-|)/^~^y-l), 

and 

tX^'" > py exp(-a*) exp(-/3„p„) + e', 

where a* is the smallest solution of 
(Texp((T) exp(-/?t,p„) = En^i. /^«*^«- We now 
perform the thinning of the arrival processes: Up to 
replacing A^ by tX^ , we can assume directly that for all 
N large enough, A^'" + eT G A^ ((1 - ^)^"^, V-l) 
and A-u > py exp(— cr) ex.p{—/3ypy) + e'. Now, we define 
the stopping time 

= inf {t > 1 : there exists a class-u user whose 
buffer is smaller than 1 + logt}. 

If we prove that for an arbitrary initial condition, 
P{T^ = 00) > then the system is transient. As 
in the previous paragraph, we consider the dominant 
system where all users of class different than v see 
saturated class-u users. Recall that, by construction, in 
this dominant system, the buffers of class-f users are 
independent of the buffers of users of class different 
than V. Note also that on the event {T^ > t} all 
class-f users are saturated on [0,t], hence on this time 
interval the dominant system and the original system 
couple. From the strong Markov property, it implies that 
P(Tj^ = 00) is equal to the probability that for all 
t > I, the buffer of all class-u users in the dominant 
system is larger than 1 + log t. Now, we may argue as 
in the W-B.ll for large enough, the dominant system 
restricted to users of class different than v is stable, and 
the asymptotic proportion of slots left idle by the queues 
of class different than v tends to exp(— cr) as goes to 
infinity. Hence, for class-u users, in the dominant system, 
the service rate converges to py exp(— o") exp{—Pypy) < 
Xy — e'. In other words, the size of the buffers of class-t; 
users has a positive drift and by a routine computation, 
it implies easily that there exists such that for all 
A^ > N„ F{T^ = oo)>0. 

VI. Extensions: The case of CSMA protocols 

The results of the previous sections can be extended 
to the case of more efficient random multiple access 
methods. For example, in CSMA systems, a user senses 
the channel before transmitting. If the channel is busy, 
the user remains silent, and when the channel is idle, the 
user can attempt to transmit packets. This allows users to 
transmit for a large number of consecutive slots without 
being interrupted, and thus significantly increases the 
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system efficiency. For example, in the case of slotted- 
Aloha, it can be easily seen that when the channel is 
shared by N users with similar characteristics, i.e., same 
arrival rate X/N and same transmission probability, then 
the maximum amount of traffic A that the system can 
support is e~^. With CSMA, this amount can be made 
arbitrarily close to 1 (as we would obtain using a perfect 
centralized multi-access scheme) just letting the channel 
holding time grow large. 

A. Model 

The model is similar than the one used for slotted- 
Aloha, except that when a user attempts to use the chan- 
nel, it keeps transmitting during a consecutive slots. In 
the current IEEE802.11g standard [12], for data packets, 
we have roughly cr 10 slots. There are N users sharing 
the resource, and at the beginning of each slot, user i 
transmits with probability pi if it senses the channel idle. 
Packets whose transmission take a slots arrive according 
to a stationary ergodic Markovian process of intensity Aj 
in the buffer of user i. 

Remark 4 (Heterogeneous systems): The analysis can 
be generalized to the case where users transmit at 
different rates, i.e., when user i keeps the channel for 
o"i slots. To keep the formulas simple we just assume 
that all users transmit packets of the same sizes and 
at the same rate, for all i, ai = a. Another possible 
generalization is to allow the collision to be shorter than 
the packet successful transmissions. This can be useful 
when one wants to model RTS/CTS signaling scheme in 
IEEE802.il -based systems. 

B. Approximate stability region 

In CSMA systems, users are synchronized in the sense 
that they observe the same periods where the channel 
is busy. The analysis of these systems can then be 
conducted as that of slotted-Aloha: it suffices to analyze 
the system at the instants corresponding to the begin- 
ning of idle slots or to the beginning of transmissions. 
The approximate stability region is then constructed as 
follows. 

For p = (pi, . . . , pn) e M^, define 7i(p): 
where 

r Pt = piPiWj^iii- pjPj), 

{ E = Wk{^- PkPk), 



The approximate stability region is the set of points 
lying below one of the boundaries djkf defined by: 

d,k^ = |A:3peaj[0, l]^,Vi,A, = 7,(p,a)|. 

Under the assumptions of Theorem [T] (see the para- 
graph above Theorem [Hi, we can show that tends 
to the actual stability region when grows large. As 
in the case of unit packet duration, we can show using 
theoretical arguments and numerical experiments that 
the approximation is extremely accurate. For example, 
the notion of /c-homogenous directions can be easily 
extended, and A^ is exact in those directions. 

VII. Conclusion 

We have provided a very accurate approximate sta- 
bility region for classical slotted-AIoha systems. This 
approximate region has been shown to be exact when 
the number of users becomes large, but is also extremely 
accurate for small systems. The analysis has been gen- 
eralized to the case of CSMA systems. 

In this paper, we have considered network scenarios 
where all users share a common channel, and that only 
a single user can transmit successfully at a time. An 
important question that remains to be investigated is the 
case where users do not interfere with all other users, 
i.e., several users can simultaneously transmit success- 
fully. For example, a popular model in the literature 
consists in modeling user interaction by an interference 
graph. In such network scenarios, how efficient are 
non-adaptive CSMA protocols? We have provided a 
preliminary analysis of such network scenarios in [7], but 
without presenting complete proofs and without being 
able to deduce results characterizing the efficiency of 
CSMA protocols. 
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Appendix 

Proof of Proposition 1. 

Consider systems obtained from the original systems 
but where each slot is available for transmission with 
probability h, i.i.d. over slots. We denote by A^(6) the 
corresponding stability region (of course it depends on 
the arrivals rates, transmission probabilities and modulat- 
ing IVIarkov for the arrival processes). We prove the result 



using Szpankowski recursive expression for A^(6). Let 
us show by induction on k that the following result holds: 
"For /c-homogeneous systems with slots available 
with probability b, and such that lfc+i<7vafc+i(l — 
Pk+i)/Pk+i < ai{l -pi)/pi and a, = for / > /c + 1, 
we have: 



pi 



-ai + Ok+i 



For k = 1, the result follows from the stability analysis 
of systems with two queues only. Assume that the result 
holds for all / < k. Consider a fc-homogeneous system. 
From [26], we know that the system is stable if and only 
if there exists i€{l,...,/c + l} such that: 

X' eA''ib{l-pi)), (18) 

Xi<bpi Yl ^cHil-Pj), (19) 

cc[k+i]\{i} jec 

where A* = (Ai, . . . , Ai_i, Ai+i, . . . , Afc+i), [k + I] = 
{1, . . . ,k + l}, and tt£ denotes the stationary probability 
that the buffers from set C are not empty in a system 
where user i has been removed and b has been replaced 
by 6(1 —pi). Note that (fTSl) ensures that these probabil- 
ities exist. 

Remark that when removing user i, the remaining 
system is (/c — l)-homogeneous. By induction, if A = sa, 
we deduce that for any i ^ A; + 1, condition (fTSl ) is 
equivalent to: 

f-ntia-p.) 



s < s 



Pi 



ai + afc+i 



(20) 



When the latter condition is satisfied, it is easy to show 
that buffer i in the original system is stable, i.e., that 
( [T9l ) holds. Indeed consider the stochastically dominant 
system where users j ^ i,k + 1 always transmit with 
probability pj. Then the stability condition of buffers 
i and /c + 1 is that of a two-buffer system with slot- 
availability probability equal to c = ^Hj^i k+i^^ ~ Pj)- 
The latter system is stable if and only if: 

Xk+iPk^ 



Ai < cpi{l 
which is equivalent to: 



c(l - p, 



^ I cpi Afc+iPfc+1. 

s<s = 1 . 

ai c(l-pi) 

One can verify that s' > s*. 

One can also show that conditions ([T8])-([T9l) with 
i = k + 1 implies stronger restrictions on s than similar 
conditions for i < k, which concludes the proof. 

Proof of Proposition |2] 
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To prove ( [13]) . we compare the system with another 
system that starts empty too, and whose evolution is 
characterized by Q where 7'^(r) is replaced by 7(A). 
We denote by Q^^*^^ (r) the solution of this new system, 

and define 7°''^(t) = Ev M'i- " Qko)(^))- We also 
denote by W^''^{t) its total workload at time r. The 
new system is equivalent to a system of V independent 
queues with Poisson modulated arrivals and constant 
capacities (equal to p^, exp(— 7(A)) for type-w queue). 
Note that the service rates of the queues in the new 
system are smaller than those in the original system. We 
deduce: for all r > 0, 

e(7°'^(r)) > e(7°(r)). 

Also remark that the original and the new systems have 
the same stationary behavior, which implies: W^{oo) = 
l^O'^(oo). Then: 

= W^ioo) - Ty°'"(oo) 

e(7°(^))-7°'^Wexp(-7(A)) 



du. 



Hence we have: 

f{u)du = f 



e-7(A) 



-7(A) 



7'^'"(m) -7(A) ]du 



du. 



To prove ([T3] ). it suffices to show that for all v £ 

V, Q^(^^q^{t) converges exponentially fast to Q^^^q^{oo) 



As mentioned previously, Q('^\)(''") 



when r — > CX3. 

represents the probability that a queue, initially empty, 
with Poisson modulated arrivals, exponential service 
requirements and constant capacity exp(— 7(A)). Thus 
to prove ( fT3] ). we just need to show that a queue 
M^/M/1 with Poisson modulated arrivals is exponen- 
tially ergodicH under the usual stability condition. This 
is what we prove next. 

Exponential ergodicity of queues with Poisson modu- 
lated arrivals. The proof of the exponential ergodicity 
of queues with Poisson modulated arrivals can be done 
classically, showing that the spectral gap of the corre- 
sponding Markov process is positive. We give the proof 
for completeness. 

Consider a queue of capacity Clients arrive 

according to a Poisson modulated process. The service 
requirements are i.i.d. exponentially distributed with 
mean 1. The arrivals are modulated by a ^-valued 

^An ergodic and stationary Markov process is exponentially er- 
godic, if its distribution converges exponentially fast to the its 
stationary distribution. 



Markov process {A{t),t > 0) whose transition kernel 
is K, and stationary distribution rj. A is a. finite set. 
When A{t) = a, clients arrive at rate Aq. Assume 
that the queue is ergodic, i.e., Z]ag_4 ^(a)Aa x /_i < 1. 
Denote by B{t) the number of clients in the queue at 
time r. Let R denote the kernel of the Markov process 
X = {{B{t),A{t)),t > 0). We have: for all k £ N, 
ae A, 

R{{k, a); {k - 1, a)) = lfc>oAi, 
R{ik,a);ik + l,a)) = Xa, 
R{{k,a);{k,b)) = K{a,h). 

Let 7r(z) denote the stationary probability to be in state 
2; = (A;, a) € Nx A Following [15], to prove exponential 
ergodicity, we just need to show that the spectral gap of 
R is strictly positive. The gap is defined by: 



gap(i?) = inf 



\ {9{w)-g{z)fR{z;w)n{z 



where JF is the set of measurable functions such that 
X;^5(^)vr(z) = 0, and Y.z 9^i^)'^(.z) = 1- The follow- 
ing lemma states the exponential ergodicity of the queue. 



Lemma 2: 



gap(i?) > 0. 



Proof. We can first show that there exist two strictly 
positive constants ci, C2 such that: for all (A;, a) £ NxA, 



ciTTQ{k,a) < 7r(/c,a) < C2iTo{k,a), 



(21) 



where 7ro(/c,a) = r?(a)(l — p)p'' for some p < 1. 
Actually, this result can be obtained using one of the 
classical methods to derive the tail of the stationary 
distribution of a queue with modulated arrivals, for 
example refer to Theorem 2.4 in [3]. 

Note that 7ro(fc, a) is the steady state distribution of a 
Markov process Xq with two independent components: 
Xq = {B p{t) , A{t) , T > 0). Bp is the Markov process 
representing the number of clients in an M/M/l queue 
with load p, and A and Bp are independent. Denote by 
Rq the transition kernel of Xq. 

From (I2T] ). one can easily deduce that there exists a 
constant c > such that kji > ckji^, where kji (resp. 
/c/Jq) is the Cheeger constant of X (resp. Xq), see [14]. 
For example, kji is defined by: 



kR{H) 



inf kR{H) where 

HmxA;0<TT{H)<l 

T,(k,a)eH ^(^' a)Riik, g); H"") 
tt{H)tt{H^) ■ 



The Cheeger constant and the spectral gap are related. 
Actually thanks to Theorems 2.1 and 2.3 in [14], there 
exists a constant C > such that: 

C X 4 < gap{R) < kR. 

The same inequalities (with a different constant C) holds 
for Rq. Now observe that gap(i?o) > 0. This is due 
to the fact that by Theorem 2.6 in [15], gap(i?o) is 
the minimum of the spectral gap of Bt and that of A. 
Both are strictly positive {Br is a birth-death process, 
see Corollary 3.8 in [15]; A can take a finite number of 
values). We conclude: 

< gap(iio) < kR^, < c-^kR < c-VC^^gap(^)- 
Hence gap(i2) > 0. 



